MOTION ESTIMATION METHOD AND DEVICE 

BACKGROUND OF THE INVENTION 

5 Field of the Invention 

The present invention relates in general to a motion 
estimation device in a digital video compression coding system 
and a method thereof, and more particularly to a motion 
estimation method and device for selecting a final motion 
10 vector to be coded, in consideration of a zero vector and a 
predicted motion vector as well as a motion vector having a 
minimum error, thereby increasing the coding efficiency . 

Description of the Prior Art 

15 Generally, video signal compression coding and decoding 

can desirably reduce the capacity of a memory necessary for 
storing image information as well as transmit the image 
information over a low-rate channel. In this regard, such 
compression coding and decoding techniques occupy a very 

20 important part of the multimedia industry requiring a variety 
of image applications such as image storage, image 
transmission, etc. 

Fig. 1 is a schematic block diagram showing the 
construction of a conventional video coding system. For the 

25 efficient video compression coding, there is generally used a 
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method for estimating a motion vector using a reference frame 
for the coding of a current frame, performing a motion 
compensated prediction operation using the estimated motion 
vector and coding the resulting prediction error. With 

5 reference to Fig. 1, the conventional video coding system 
comprises a transform unit 20 for performing a transform 
operation for a frame difference between an input frame and a 
motion compensated prediction frame obtained by a motion 
compensation predictor 10, a quantizer 30 for quantizing 

10 transform coefficients from the transform unit 20 for data 
compression, a variable length coder 40 for performing a 
variable length coding (VLC) operation for the transform 
coefficients quantized by the quantizer 30, a dequantizer 50 
and an inverse transform unit 60. In this coding system, the 

15 frame difference is reconstructed by the dequantizer 50 and 
inverse transform unit 60 and applied to the motion 
compensation predictor 10 for the next frame prediction. On 
the other hand, the motion compensation predictor 10 performs 
a motion vector estimation operation using the input frame and 

20 the reference frame and finds the prediction frame using an 
estimated motion vector. The motion compensation predictor 10 
also performs a motion compensated prediction operation and 
transfers the estimated motion vector to the variable length 
coder 40, which then variable length codes and transmits it 

25 together with the transform coefficients quantized by the 
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quantizer 30. An image information bit stream output from the 
variable length coder 40 is transmitted to a receiver or a 
multiplexer for its multiplexing with other signals. 

In a general video coding method and system, motion 

5 prediction and compensation operations are not performed on a 
frame basis, but in the unit of a predetermined number of 
picture elements or pixels (M pixels in the horizontal 
direction and N pixels in the vertical direction, typically 
indicated by MxN pixels) . This group of pixels is typically 

10 called a macroblock. It is generally prescribed that the 
macroblock be sized with 16 pixels in the horizontal direction 
and 16 pixels in the vertical direction (referred to 
hereinafter as "16x16") . In the present invention, although 
the size of the macroblock is not limited to a specific value, 

15 it will be described as 16x16 as an example for the 
convenience of description. A motion vector is two- 
dimensional information indicative of the quantity of motion 
of an object in the reference and current frames on two- 
dimensional X-Y coordinates. Namely, the motion vector 

20 consists of a transversal motion value and a longitudinal 
motion value. 

Fig. 2 is a detailed block diagram of the motion 
compensation predictor 10 in the conventional video coding 
system of Fig. 1. As shown in this drawing, the motion 
25 compensation predictor 10 includes a motion compensation unit 
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11 for performing a motion compensation operation, a motion 
estimation unit 12 for performing a motion vector estimation 
operation, and a previous image reconstruction unit 13 for 
obtaining a reconstructed version of the previous frame to be 

5 used to obtain the motion compensated prediction frame. 
Although the previous frame is used as the reference frame in 
Fig. 2, the next frame may be used as the reference frame for 
an increase in prediction efficiency in any other coding 
system. The previous image reconstruction unit 13 obtains a 

10 reconstructed version of the coded frame by adding the 
reconstructed version of the frame difference transferred from 
the inverse transform unit 60 to a previous reconstructed 
frame stored therein. The reconstructed frame obtained by the 
previous image reconstruction unit 13 is then used as an input 

15 to the motion estimation unit 12 for the motion estimation of 
the subsequent input frame. The motion estimation unit 12 
performs the motion vector estimation operation for the coding 
of the current frame on the basis of an output from the 
previous image reconstruction unit 13 and the input frame and 

20 outputs the resulting motion vector, which is then transferred 
to the variable length coder 40 for its variable length 
coding. The variable length coder 40 can code input values 
with a much smaller number of bits than fixed length coding 
(FLC) by assigning a smaller number of bits to a value with a 

25 higher generation frequency and a larger number of bits to a 
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value with a lower generation frequency, respectively. On the 
other hand, the motion vector output from the motion 
estimation unit 12 is applied to the motion compensation unit 
11, which then performs the motion compensation operation 

5 using the applied motion vector and thus finally produces the 
prediction frame. 

As stated previously, the motion vector estimation 
operation is performed on a macroblock basis. This motion 
vector estimation signifies a procedure for searching a 

10 previous frame for a portion most similar to a current frame 
block. A conventional motion vector estimation method does 
not utilize information of macroblocks surrounding a 
macroblock of a current frame, but searches a previous frame 
for a portion most similar to the current frame macroblock. 

15 A motion vector has a close correlation with the 

surrounding blocks or macroblocks because of image 
characteristics. Accordingly, the coding efficiency can be 
increased by variable length coding a difference vector 
between a current motion vector and a motion vector predicted 

20 using motion vectors of the surrounding blocks or macroblocks, 
rather than directly variable length coding the current motion 
vector. The reason is that the difference vector is 0 or a 
value approximate to 0 at a significantly high frequency. 

Generally, a predicted motion vector can be determined 

25 using adjacent motion vectors in the following manner. 
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Namely, the predicted motion vector is determined as the 
median value of motion vectors of the left, upper and upper 
right blocks or macroblocks around a current block or 
macroblock. A difference vector between the determined 

5 predicted motion vector and the current motion vector is 
obtained and then variable length coded. This method is 
typically used in ITU-T H.263 and ISO/IEC MPEG-4. 

Fig. 3 is a view illustrating motion vectors of the left, 
upper and upper right blocks or macroblocks around a 

10 macroblock to be currently coded, when the current macroblock 
is in a 16x16 mode. In this drawing, MVa can be interpreted 
to be of two types. It represents a motion vector of the left 
macroblock if the left macroblock is in the 16x16 mode, and a 
motion vector of a block positioned above the right-hand side 

15 of the left macroblock if the left macroblock is in an 8x8 
mode. Similarly, MVb represents a motion vector of the upper 
macroblock if the upper macroblock is in the 16x16 mode, and a 
motion vector of a block positioned below the left-hand side 
of the upper macroblock if the upper macroblock is in the 8x8 

20 mode. Similarly, MVc represents a motion vector of the upper 
right macroblock if the upper right macroblock is in the 16x16 
mode, and a motion vector of a block positioned below the 
left-hand side of the upper right macroblock if the upper 
right macroblock is in the 8x8 mode. 

25 A motion vector estimated in a general motion search 
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manner has a value selected to minimize the motion compensated 
error, not considering the coding efficiency of the motion 
vector. For this reason, a bit stream of a coded motion 
vector may exhibit a considerable difference in size even when 

5 a motion compensated error has a slight difference. There is 
a conventional method for conducting no coding when motion 
compensated errors resulting from a motion vector estimated in 
a motion search method and a zero vector are below 
predetermined threshold values. However, this method is 

10 effective for only frames with little variations. In other 
words, it cannot effectively perform a motion estimation 
operation for frames with variations. 

SUMMARY OF THE INVENTION 

15 

Therefore, the present invention has been made in view of 
the above problems, and it is an object of the present 
invention to provide a motion estimation method and device for 
selecting a motion vector to increase the coding efficiency 

20 irrespective of an increase in motion compensated error, in a 
different manner from conventional motion estimation systems 
for selecting the motion vector to minimize the motion 
compensated error, thereby enhancing the entire efficiency of 
a coding system in terms of rate-distortion. 

25 In accordance with one aspect of the present invention, 
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the above and other objects can be accomplished by the 
provision of a motion vector estimation method comprising the 
first step of obtaining a predicted motion vector on the basis 
of motion vectors of blocks surrounding a block to be 

5 currently coded; the second step of searching for a motion 
vector with a minimum motion compensated error and, meanwhile, 
obtaining the minimum motion compensated error, a motion 
compensated error of a zero vector and a motion compensated 
error of the predicted motion vector; the third step of 

10 comparing the motion compensated error of the zero vector with 
a first predetermined threshold value; the fourth step of 
determining the zero vector as a final motion vector if it is 
determined at the above third step that the motion compensated 
error of the zero vector is smaller than the first 

15 predetermined threshold value; the fifth step of comparing the 
motion compensated error of the predicted motion vector with a 
second predetermined threshold value if it is determined at 
the above third step that the motion compensated error of the 
zero vector is not smaller than the first predetermined 

20 threshold value; the sixth step of determining the predicted 
motion vector as the final motion vector if it is determined 
at the above fifth step that the motion compensated error of 
the predicted motion vector is smaller than the second 
predetermined threshold value; and the seventh step of 

25 determining the motion vector with the minimum motion 
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compensated error as the final motion vector if it is 
determined at the above fifth step that the motion compensated 
error of the predicted motion vector is not smaller than the 
second predetermined threshold value. 

5 In accordance with another aspect of the present 

invention, there is provided a motion vector estimation device 
comprising a motion vector predictor for obtaining a predicted 
motion vector on the basis of motion vectors of blocks 
surrounding a block to be currently coded, stored in a motion 

10 vector memory; a motion vector searcher for searching for a 
motion vector with a minimum motion compensated error using a 
current frame and a reference frame and, meanwhile, obtaining 
the minimum motion compensated error, a motion compensated 
error of a zero vector and a motion compensated error of the 

15 predicted motion vector; a motion vector selector for 
receiving the motion vector with the minimum motion 
compensated error, the minimum motion compensated error, the 
motion compensated error of the zero vector and the motion 
compensated error of the predicted motion vector from the 

20 motion vector searcher, the predicted motion vector from the 
motion vector predictor and first and second threshold values 
and then determining a final motion vector using the received 
information; and the motion vector memory adapted to receive 
and store the final motion vector determined by the motion 

25 vector selector. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The above and other objects, features and advantages of 
the present invention will be more clearly understood from the 
5 following detailed description taken in conjunction with the 
accompanying drawings, in which: 

Fig. 1 is a schematic block diagram showing the 
construction of a conventional video coding system; 

Fig. 2 is a detailed block diagram of a motion 
10 compensation predictor in the conventional video coding system 
of Fig. 1; 

Fig. 3 is a view illustrating motion vectors of blocks 
around a macroblock to be currently coded, when the current 
macroblock is in a 16x16 mode; 
15 Fig. 4 is a flowchart illustrating a motion estimation 

method in accordance with the preferred embodiment of the 
present invention; and 

Fig. 5 is a schematic block diagram showing the 
construction of a motion estimation device in accordance with 
20 the preferred embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Abbreviations used in the specification can be defined as 
25 follows before describing the present invention in detail. 
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The reference character "MED ( )" denotes a function for 
extracting the median value of elements in parentheses. For 
example, MED(1,3,7) = 3. 

The reference character "SAD" denotes the sum of absolute 
5 differences, which is an example of a motion compensated error 
used in the present invention. 

The reference character "MVZ" denotes a zero vector 
(0,0) . 

The reference character "MVP" denotes a predicted motion 
10 vector obtained on the basis of the surrounding macroblocks. 

The reference character "MVM" denotes a motion vector 
selected to minimize the motion compensated error. 

The reference character "SAD_Z" denotes an SAD of one 
macroblock between a previous frame and a current frame, 
15 obtained on the basis of the zero vector MVZ. 

The reference character "SAD_P" denotes an SAD of one 
macroblock between a previous frame and a current frame, 
obtained on the basis of MVP. 

The reference character "SAD_M" denotes an SAD of one 
20 macroblock between a previous frame and a current frame, 
obtained on the basis of MVM. 

Generally, a video coding system is adapted to perform a 
motion vector searching operation to calculate motion 
compensated errors of motion vectors within a searching range 
25 and select a motion vector having the minimum motion 
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compensated error, from among the motion vectors. The present 
invention is characterized in that a motion estimation 
operation is performed on the basis of not only a motion 
vector with a minimum motion compensated error, but also a 

.5 motion compensated error of a zero vector and a motion 
compensated error of a predicted motion vector obtained using 
a motion prediction process. In the case where the motion 
compensated error of the zero vector is sufficiently small 
(for example, below a first threshold value), a satisfactory 

10 picture quality can be obtained by using a previous frame 
directly without performing a coding operation. In this case, 
the coding efficiency becomes very high by performing no 
coding and transmitting a very short code indicative of the 
no-coding state. In the case where the motion compensated 

15 error of the zero vector is somewhat large (for example, above 
the first threshold value) and the motion compensated error of 
the predicted motion vector is somewhat small (for example, 
below a second threshold value) , the predicted motion vector' 
is coded and transmitted. Notably, the current motion vector 

20 itself is not actually coded, but a difference vector between 
the current motion vector and the predicted motion vector is 
variable length coded and transmitted. As a result, the 
difference vector becomes 0 if the predicted motion vector is 
selected. This difference vector of 0 is a symbol of the 

25 highest generation frequency, which is coded into the shortest 
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bit stream and then transmitted, thereby significantly 
increasing the coding efficiency. In the case where the 
motion compensated error of the zero vector and the motion 
compensated error of the predicted motion vector are above a 

5 specific threshold value (for example, the second threshold 
value) , the motion vector with the minimum motion compensated 
error, obtained during the motion estimation operation, is 
selected as the final motion vector and then coded. 

In the present invention, the determination of the above- 

10 mentioned first and second threshold values is not limited to 
a particular method. Any method may be used to determine the 
first and second threshold values, as long as the second 
threshold value is set to be larger than the first threshold 
value. The first and second threshold values can be preset to 

15 have values determined to be of uniform high quality with 
respect to all frames through many experiments. 
Alternatively, these values may be adaptively calculated and 
used for a specific video signal during a digital video coding 
operation. 

20 Fig. 4 is a flowchart illustrating a motion estimation 

method in accordance with the preferred embodiment of the 
present invention. The respective steps of the present motion 
estimation method can be performed in the below manner. 

At the first step SI, a predicted motion vector MVP is 

25 obtained on the basis of motion vectors of blocks surrounding 
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a block to be currently coded. In the present invention, a 
function for obtaining the predicted motion vector MVP is not 
limited to a particular function. For example, the predicted 
motion vector MVP may be obtained by taking the median value 
5 of motion vectors of blocks or macroblocks surrounding a block 
or macroblock to be currently coded, as in the following 
equation 1 . 

[Equation 1] 
10 MVP = MED(MVl,MV2,MV3) 

where, MV1, MV2 and MV3 represent motion vectors of 
macroblocks surrounding a macroblock to be currently coded, 
respectively. 

15 At the second step S2, a motion vector MVM having a 

minimum motion compensated error is searched for on the basis 
of the predicted motion vector MVP obtained the above first 
step SI. The minimum motion compensated error (e.g., SAD_M) , 
a motion compensated error (e.g., SAD_Z) of a zero vector MVZ 

20 and a motion compensated error (e.g., SAD_P) of the predicted 
motion vector are also obtained at the second step S2 . For 
example, assuming that a macroblock to be currently coded is 
in a 16x16 mode and a motion vector thereof is (x, y), an SAD 
(Sum of Absolute Difference) of one macroblock between a 

25 previous frame and a current frame may be obtained as a motion 
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compensated error of the motion vector as in the following 
equation 2. It should be noted that the SAD is used as the 
motion compensated error in Fig. 4 for the convenience of 
description. In the present invention, the motion compensated 
5 error is not limited to the SAD. 

[Equation 2] 

SAD(x, y) = QQ \p(i, j) - p(i + x,j + y)\ 

j=0 j=0 

10 It should also be noted that the search for a motion 

vector with a minimum compensated error within a given search 
area is not limited to a particular search method. In the 
present invention, all motion search methods including, for 
example, a full search, pyramidal search and three-step search 

15 can be used to search for a motion vector with a minimum 
compensated error. 

In the present invention, in order to minimize a motion 
compensated error, a zero vector and a predicted motion vector 
can be contained within a given search range. Therefore, 

20 motion compensated errors of the zero vector and predicted 
motion vector are obtained not separately from a motion vector 
with a minimum motion compensated error, but automatically 
while the motion vector with the minimum motion compensated 
error is searched for. 

15 
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At the third step S3, the motion compensated error SAD_Z 
of the zero vector MVZ obtained at the above second step S2 is 
compared with a first threshold value TH1 . If SAD_Z is 
smaller than TH1, the fourth step S4 is performed to determine 

5 the zero vector MVZ as the final motion vector. Then, the 
motion estimation for the current macroblock is ended. - On the 
other hand, if SAD_Z is not smaller than THl, the fifth step 
S5 is performed. 

At the fifth step S5, the motion compensated error SAD_P 

10 of the predicted motion vector MVP obtained at the above 
second step S2 is compared with a second threshold value TH2. 
If SAD_P is smaller than TH2, the sixth step S6 is performed 
to determine the predicted motion vector MVP as the final 
motion vector. Then, the motion estimation for the current 

15 macroblock is ended. However, if SAD_P is not smaller than 
TH2, the seventh step S7 is performed to determine the motion 
vector MVM with the minimum motion compensated error as the 
final motion vector. Then, the motion estimation for the 
current macroblock is ended. 

20 Fig. 5 is a schematic block diagram showing the 

construction of a motion estimation device in accordance with 
the preferred embodiment of the present invention. As shown 
in this drawing, the present motion estimation device 
comprises a motion vector predictor 110, motion vector 

25 searcher 120, motion vector selector 130 and motion vector 
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memory 140. 

In the motion estimation device of the present invention, 
the motion vector predictor 110 is adapted to obtain a 
predicted motion vector MVP on the basis of motion vectors of 

5 blocks surrounding a block to be currently coded, stored in 
the motion vector memory 140. 

The motion vector searcher 120 is adapted to search for a 
motion vector with a minimum motion compensated error using an 
input frame and a reference frame and, meanwhile, obtain the 

10 minimum motion compensated error (e.g., SAD_M) , a motion 
compensated error (e.g., SAD_Z) of a zero vector MVZ and a 
motion compensated error (e.g., SAD_P) of the predicted motion 
vector. In detail, the motion vector searcher 120 includes a 
first motion compensated error calculator for calculating the 

15 motion compensated error of the zero vector using the zero 
vector, the input frame and the reference frame, and a second 
motion compensated error calculator for calculating the motion 
compensated error of the predicted motion vector using the 
predicted motion vector, the input frame and the reference 

20 frame . 

It should be noted that means for obtaining the motion 
vector with the minimum motion compensated error is not 
limited to specific search means. For example, the motion 
vector searcher 120 may be arbitrary search means such as full 
25 search means, pyramidal search means, three-step search means 
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or four-step search means, as long as it can search for the 
motion vector MVM with the minimum motion compensated error 
within a given search area. 

In the motion estimation device of the present invention, 

5 the motion vector selector 130 is adapted to receive the 
motion vector MVM with the minimum motion compensated error, 
the minimum motion compensated error SAD_M, the motion 
compensated error SAD_Z of the zero vector and the motion 
compensated error SAD_P of the predicted motion vector from 

10 the motion vector searcher 120, the predicted motion vector 
MVP from the motion vector predictor 110 and the first and 
second threshold values TH1 and TH2 and then determine the 
final motion vector using the received information. 

The motion vector selector 130 includes a first 

15 comparator for comparing the motion compensated error of the 
zero vector from the first motion compensated error calculator 
with the first threshold value, a second comparator for 
comparing the motion compensated error of the predicted motion 
vector from the second motion compensated error calculator 

20 with the second threshold value, a first switch for enabling 
the second comparator or selecting the zero vector in 
accordance with the result compared by the first comparator, 
and a second switch for selecting one of the motion vector 
with the minimum motion compensated error, outputted from a 

25 third motion compensated error calculator, and the predicted 
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motion vector in accordance with the result compared by the 
second comparator. 

The first switch is adapted to select the zero vector as 
the final motion vector if the result compared by the first 

5 comparator indicates that the motion compensated error of the 
zero vector is smaller than the first threshold value, and 
enable the second comparator, otherwise. The second switch is 
adapted to select the predicted motion vector as the final 
motion vector if the result compared by the second comparator 

10 indicates that the motion compensated error of the predicted 
motion vector is smaller than the second threshold value, and 
the motion vector with the minimum motion compensated error as 
the final motion vector, otherwise. 

The motion vector memory 140 is adapted to receive and 

15 store the final motion vector from the motion vector selector 
130 and supply the motion vectors of the blocks surrounding 
the block to be currently coded, to the motion vector 
predictor 110. 

It should be noted that the first and second threshold 
20 values are not limited to particular values as long as the 
second threshold value is set to be greater than the first 
threshold value. The first and second threshold values can be 
preset to have values determined to be of uniform high quality 
with respect to all frames through many experiments. As an 
25 alternative, these values may be adaptively calculated and 
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used for a specific video signal during a digital video coding 
operation. In the present invention, the use of two threshold 
values is more meaningful than the setting thereof to 
particular values. Also, it should be noted that the present 

5 motion estimation device shown in Fig. 5 is a part of a 
digital video coder. Although not shown in Fig. 5, a 
controller controlling the entire operation of the coder is 
adapted to determine the first and second threshold values. 

As apparent from the above description, the present 

10 invention provides a motion estimation method and device which 
can adaptively select a motion vector from among a zero 
vector, a predicted motion vector and a motion vector with a 
minimum motion compensated error using an appropriate weight 
in consideration of bit lengths of motion vectors generated 

15 together with motion compensated errors during a motion 
estimation operation. Therefore, the present invention has 
the effect of increasing a video coding efficiency. 

Although the preferred embodiments of the present 
invention have been disclosed for illustrative purposes, those 

20 skilled in the art will appreciate that various modifications, 
additions and substitutions are possible, without departing 
from the scope and spirit of the invention as disclosed in the 
accompanying claims . 
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